United States Patent and Trademark Office 



UNITED STATES DEPARTMENT OF COMMERCE 
United States Patent and Trademark Office 
Address: COMMISSIONER FOR PATENTS 
P.O. Box 1450 

Alexandria, Virginia 22313-1450 
www.uspto.gov 



APPLICATION NO. 


FILING DATE 


FIRST NAMED INVENTOR 


ATTORNEY DOCKET NO. 


CONFIRMATION NO. 


09/766,577 


01/23/2001 


Norio Nagai 


0905-0254P-SP 


2339 



2292 7590 07/16/2007 

BIRCH STEWART KOLASCH & BIRCH 
PO BOX 747 

FALLS CHURCH, VA 22040-0747 



EXAMINER 



MISLEH, JUSTIN P 



ART UNIT 



PAPER NUMBER 



2622 



NOTIFICATION DATE 



DELIVERY MODE 



07/16/2007 ELECTRONIC 

Please find below and/or attached an Office communication concerning this application or proceeding. 

The time period for reply, if any, is set in the attached communication. 

Notice of the Office communication was sent electronically on above-indicated "Notification Date' 1 to the 
following e-mail address(es): 

mailroom@bskb.com 



PTOL-90A (Rev. 04/07) 



Office Action Summary 


Application No. 

09/766,577 


Applicant(s) 

NAGAI, NORIO 


examiner 

Justin P. Misleh 


Art Unit 

2622 





- The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 . 1 36(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

I) ^ Responsive to communication(s) filed on 04 June 2007 . 

2a)S This action is FINAL. 2b)Q This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) E3 Claim(s) 1. 2. and 5- 10 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) £3 Claim(sV 1, 2, and 5 - 10 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) Q The specification is objected to by the Examiner. 

10)^ The drawing(s) filed on 23 January 2001 is/are: a)E3 accepted or b)D objected to by the Examiner. 
Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

I I) D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12)^3 Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f), 
a)IEI All b)D Some * c)Q None of: 

1 .El Certified copies of the priority documents have been received. 

2.0 Certified copies of the priority documents have been received in Application No. . 

3.0 Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



Attachment(s) 

1) D Notice of References Cited (PTO-892) 

2) CH Notice of Draftsperson's Patent Drawing Review (PTO-948) 

3) □ Information Disclosure Statement(s) (PTO/SB/08) 

Paper No(s)/Mail Date . 



4) O Interview Summary (PTO-413) 

Paper No(s)/Mail Date. . 

5) [Zl Notice of Informal Patent Application 

6) □ Other: . 



U.S. Patent and Trademark Office 
PTOL-326 (Rev. 08-06) 



Office Action Summary 



Part of Paper No./Mail Date 062507 



Application/Control Number; 09/766,577 Page 2 

Art Unit: 2622 

DETAILED ACTION 

Response to Arguments 

1 . Applicant's arguments filed June 4, 2007 have been fully considered but they are not 
persuasive. 

2. Applicant argues, "Kowno displays the line-drawing (including the dragging starting 
point "a") as soon as the pen tip makes contact with the LCD 6; i.e., immediately after initiation 
of a designating operation of the electronic zoom area by a user. In contrast, in the claimed 
invention of the present application, c a mark indicative of a center point of an electronic zoom 
area' is displayed 'prior to initiation of a designating operation of the electronic zoom area by a 
user,' as recited in claim 1." 

3. The Examiner respectfully disagrees with Applicant's position. Kwono et al. disclose, as 
stated in paragraph 0102, "the user can observe on the LCD 6 the point at a location pressed by 
the tip of the pen 41 so that the user feels as if the user directly input the point using the pen 41 
on the LCD 6." Kwono et al. additionally disclose, as stated in paragraph 0161, "the tip of the 
pen 41 presses on a dragging starting point 'a' of the touch tablet 6 A disposed over the LCD 6 
when a specified image is displayed on the LCD 6" and, subsequently, "The pen tip is dragged 
while pressing against touch tablet 6 A to a dragging ending point 6 b'." 

4. Based on the above-statements, the Examiner believes the electronic zooming of Kwono 
et al. take place in two operations: 1) a first pressing operation to indicate a dragging start point 
and 2) a second dragging operation to indicate a dragging end point and electronic zoom area. 
The Examiner submits that the electronic zoom area is not designated until the dragging in 
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second the operation commences. In other words, the dragging operation corresponds to the 
claimed "designating operation of the electronic zoom area by a user" and the pressing operation 
corresponds to that claimed "prior to initiation of a designating operation". Therefore, the 
Kwono et al. indeed disclose "a mark indicative of a center point of an electronic zoom area" is 
displayed "prior to initiation of a designating operation of the electronic zoom area by a user," as 
claimed. 

5. Finally, the Examiner notes Applicant's claim language is written broadly enough such 
that it does not necessarily require the details of how and when the designation of the electronic 
zoom area is initiated. 



Claim Rejections - 35 USC § 103 

6. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

7. Claims 1, 2, and 5-8 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Kowno et al. in view of Okamura in further view of Miyawaki et al. 

The Response section above is fully incorporated into the following rejections. 
Furthermore, the Examiner respectfully notes that apparatus Claim 8 is fully encompassed by 
apparatus Claim 1 and that method Claim 2 substantially and substantively parallels apparatus 
Claim 1. Accordingly, these independent claims will be rejected together. 



Summary of Kowno et al. 
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Kowno et al. disclose, as stated in paragraphs 42, 56, 78, 81, 99, 157, 159, 162, 163, 170, 
176, 184, and 185, an image sensing apparatus (1; figures 1 - 4) comprising optical zooming (via 
the lens system 3; figures 1 - 4) and electronic zooming (via CPU 39; figure 4) wherein the 
zooming is actuated via a standard telephoto/wide angle switch (15; figure 1) or via a user 
designation (see figures 8 - 1 1) on an display screen (via LCD 6; figures 2 and 4). 

Kowno et al. also disclose that during image composition, when a preview image is 
displayed on the display screen (6), a user may operate the switch (15) or may designate, using 
the touch tablet (6A; figures 2 and 4), an area (via "a", "b", and "X" - figure 8) on the display 
screen (6) to perform zooming on the preview image (see transition from figures 8 -> 9). 

According to Kowno et al., the zooming maybe strictly optical zooming by adjusting the 
focal length of a lens system (3; paragraph 157), maybe strictly digital zooming by enlarging 
through interpolation (paragraph 157), or maybe a combination of optical zooming and digital 
zooming (paragraph 181). 

Lastly, Kowno et al. disclose a strobe/flash (4) for illuminating a scene, as necessary, 
during image composition (paragraph 42, 78, and 99). 

8. For Claims 1, 2, and 8, Kowno et al. disclose an image sensing apparatus (1) and a 
method of operating thereof comprising: 

an image sensing device (CCD 20) for sensing the image of a subject and outputting 
image data representing the image of the subject; 

a display control unit (CPU 39) for controlling a display unit (LCD 6) in such a manner 
that the image of the subject represented by the image data output from said image sensing 
device (CCD 20) will be displayed on a display screen (LCD 6), the display control unit (39) also 
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displaying, on the image of the subject (figure 8), a mark ("dragging starting point 'a'") 
indicative of a center point of an electronic zoom area prior to initiation of a designating 
operation of the electronic zoom area by a user (see explanation below), the center point of the 
electronic zoom area being different from a center point of the image of the subject (The 
distinction between the original image with electronic zoom center point a in figure 8 and the 
electronically zoomed image in figure 9 also with center point a represents "different" center 
points. Also see paragraph 0162.); 

a designating unit (Touch Tablet 6A) for designating the electronic zoom area (figures 8 

and 9); 

an electronic zoom device that electronically magnifies the image in the designated 
electronic zoom area (see figures 8-11); 

a light-emission control unit (Strobe Driving Circuit 37) for controlling a strobe light- 
emission device (Strobe 4). 

Specifically, Kwono et al. first state (see paragraph 0161), "the tip of the pen 41 presses 
on a dragging starting point 'a' of the touch tablet 6 A disposed over the LCD 6 when a specified 
image is displayed on the LCD 6." Subsequently, as Kwono et al. state (again see paragraph 
0161), "the pen tip is dragged while pressing against touch tablet 6 A to a dragging ending point 
'b"\ Hence, the dragging starting point "a" corresponds to the claimed "mark". Also, in 
paragraph 109, Kwono et al. state that anytime "pen input is executed", the input and the image 
data are combined and "displayed on the LCD 6". Therefore, since dragging starting point "a" is 
indicated on the display, by the pen input, as indicative of the center of an electronic zoom area, 
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the starting point "a" is displayed on the display prior to electronic zoom designation and 
electronic zooming. 

The Examiner believes the electronic zooming of Kwono et al. take place in two 
operations: 1) a first pressing operation to indicate a dragging start point and 2) a second 
dragging operation to indicate a dragging end point and electronic zoom area. The Examiner 
submits that the electronic zoom area is not designated until the dragging in second the operation 
commences. In other words, the dragging operation corresponds to the claimed "designating 
operation of the electronic zoom area by a user" and the pressing operation corresponds to that 
claimed "prior to initiation of a designating operation". Therefore,; the Kwono et al. indeed 
disclose "a mark indicative of a center point of an electronic zoom area" is displayed "prior to 
initiation of a designating operation of the electronic zoom area by a user," as claimed. 
Moreover, the Examiner notes Applicant's claim language is written broadly enough such that it 
does not necessarily require the details of how and when the designation of the electronic zoom 
area is initiated. 

While Kowno et ah teach illuminating an entire sensed image, which fully encompasses 
illuminating a part of the subject that corresponds to an image within the electronic zoom area in 
the entire sensed image and a recording control unit (CPU 39) for recording, on a recording 
medium (Memory Card 24), an image that has been captured by the image sensing device (CCD 
20) after the image has been composed; Kowno et al. do not specifically disclose a light- 
emission control unit that is for controlling a strobe light-emission device in such a manner that 
the strobe light-emission device illuminates precisely a position of a subject that corresponds to 
the center point of the designated electronic zoom area. 
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In regards to the light emitting angle, in analogous art, Okamura also disclose an image 
sensing apparatus and a method of operating thereof including designating a zoom feature. More 
specifically, Okamura teaches, as shown in figures 1 and 2 and as stated in columns 3 (lines 1 - 
5, 34 - 45, and 62 - 67) and 4 (lines 1 - 20), an image sensing apparatus including a zoom 
switch (113) such that when the zoom switch (1 13) is operated, a zoom lens (102) is moved 
accordingly, wherein a flash control device (109), also included in the image sensing apparatus, 
controls an angle of illumination of the flash (110) to correspond to a zoomed sensed image. 
Moreover, Okamura "controls the illuminating angle of the flash device 110 according to the 
magnification varying information." Therefore, Okamura provides said light control unit 
changing a light emitting angle of the strobe light-emission device based on the zoomed image, 
as claimed. The Examiner stresses since the test for obviousness is what the combined teachings 
of the references would have suggested to those of ordinary skill in the art, it is irrelevant 
whether or not the zooming performed by Okamura is an optical zoom or an electronic zoom . 

Therefore, at the time the invention was made, it would have been obvious to one with 
ordinary skill in the art to have changed a light emitting angle of the strobe light-emission device 
based on the electronically magnified image, as suggested by Okamura, in the image sensing 
apparatus and corresponding method, disclosed by Kowno et al., for the advantage of "taking a 
shot of an object with an adequate amount of exposure " (see column 1, lines 20 - 22, of 
Okamura). 

Although, Kwono et al. in view of Okamura still do not disclose recording on the 
recording medium image data output from said image sensing device AND data indicating 
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position of the electronic zoom area OR image data representing the image with the electronic 
zoom area. 

In regards to the recording, in analogous art, Miyawaki et al. also disclose an image 
sensing apparatus for sensing an image of a subject and a designating unit for designating an 
electronic zoom area in the image of the subject. More specifically, Miyawaki et al. teach, as 
shown in figures 1 1 - 13, an image sensing apparatus for sensing an image of a subject (101) and 
a designating unit (104) for designating an electronic zoom area in the image of the subject (see 
sequence in figure 12). Furthermore, Miyawaki et al. also teach, as shown in figure 14 and as 
stated in column 13 (lines 18 - 54), that an image corresponding to an image within the 
electronic zoom area (child image plane) and that the sensed image (total image plane) may be 
superimposed and recorded in a recording medium (103). Therefore, Miyawaki et al. provides 
recording on the recording medium (103) image data output from said image sensing device 
(total image plane) AND image data representing the image with the electronic zoom area (child 
image plane). 

Therefore, at the time the invention was made, it would have been obvious to one with 
ordinary skill in the art have recording on the recording medium image data output from said 
image sensing device and image data representing the image with the electronic zoom area, as 
taught by Miyawaki et al., in the image sensing apparatus, disclosed by Kowno et al. in view of 
Okamura, for the advantage of providing a user perspective on the accuracy of user instructed 
image composition (see column 14, lines 30 - 39, of Miyawaki et al.). 

9. As for Claim 5, Kowno et al. disclose, as shown in figure 1, wherein said apparatus is a 
digital still camera (1). 
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10. As for Claim 6, Kowno et al. disclose, as stated in paragraphs 183 and 185, wherein said 
designating unit (Touch Tablet 6A) is a zoom-area designating switch of said digital still camera 
(1). 

As shown in figure 2, the touch tablet (6 A) is a part of the digital still camera (1). As 
stated in paragraphs 183 and 185, the touch tablet (6A) is used for designating the electronic 
zoom area on the image captured by the camera (1). Accordingly, the Examiner considers the 
touch table (6A) to be a zoom-area designating switch. 

11. As for Claim 7, Kowno et al. disclose, as stated in paragraphs 50 and 157, wherein the 
electronic zoom device electronically magnifies the image in the designated zoom area by 
changing a downsampling ratio ("thinning"). 

12. Claims 9 and 10 are rejected under 35 U.S. C. 103(a) as being unpatentable over Kowno 
et al. in view of Okamura. 

The Summary of Kowno et al section above is fully incorporated into the following 
rejections. Additionally, the Response section above is fully incorporated into the following 
rejections. 

13. For Claim 9, Kowno et al. disclose an image sensing apparatus (1) and a method of 
operating thereof comprising: 

an image sensing device (CCD 20) for sensing the image of a subject and outputting 
image data representing the image of the subject; 

a display unit (LCD 6) for displaying the image of the subject (figure 8) represented by 
the image data, the display unit (LCD 6) also displaying, on the image of the subject (figure 8), a 
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mark ("dragging starting point V") indicative of a center point of an electronic zoom area prior 
to designation of the electronic zoom area (see explanation below), the center point of the 
electronic zoom area being different from a center point of the image of the subject (The 
distinction between the original image with electronic zoom center point a in figure 8 and the 
electronically zoomed image in figure 9 also with center point a represents "different" center 
points. Also see paragraph 0162.); 

an electronic zoom device that designates (Touch Tablet 6A) an electronic zoom area 
(figures 8 and 9) in the image of the subject and electronically magnifies the image in the 
designated electronic zoom area (see figures 8-11), and specifies a center point of the electronic 
zoom area (see explanation below), the specified center point being different from a center point 
of the image of the subject represented by the image data output from said image sensing device 
(The distinction between the original image with electronic zoom center point a in figure 8 and 
the electronically zoomed image in figure 9 also with center point a represents "different" center 
points. Also see paragraph 0162.); and 

a light-emission control unit (Strobe Driving Circuit 37) for controlling a strobe light- 
emission device (Strobe 4). 

Specifically, Kwono et al. first state (see paragraph 0161), "the tip of the pen 41 presses 
on a dragging starting point 6 a' of the touch tablet 6 A disposed over the LCD 6 when a specified 
image is displayed on the LCD 6." Subsequently, as Kwono et al. state (again see paragraph 
0161), "the pen tip is dragged while pressing against touch tablet 6 A to a dragging ending point 
'b"\ Hence, the dragging starting point "a" corresponds to the claimed "mark". Also, in 
paragraph 109, Kwono et al. state that anytime "pen input is executed", the input and the image 
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data are combined and "displayed on the LCD 6". Therefore, since dragging starting point "a" is 

i 

indicated on the display, by the pen input, as indicative of the center of an electronic zoom area, 
the starting point "a" is displayed on the display prior to electronic zoom designation and 
electronic zooming. 

The Examiner believes the electronic zooming of Kwono et al. take place in two 
operations: 1) a first pressing operation to indicate a dragging start point and 2) a second 
dragging operation to indicate a dragging end point and electronic zoom area. The Examiner 
submits that the electronic zoom area is not designated until the dragging in second the operation 
commences. In other words, the dragging operation corresponds to the claimed "designating 
operation of the electronic zoom area by a user" and the pressing operation corresponds to that 
claimed "prior to initiation of a designating operation". Therefore, the Kwono et al. indeed 
disclose "a mark indicative of a center point of an electronic zoom area" is displayed "prior to 
initiation of a designating operation of the electronic zoom area by a user," as claimed. 
Moreover, the Examiner notes Applicant's claim language is written broadly enough such that it 
does not necessarily require the details of how and when the designation of the electronic zoom 
area is initiated. 

While Kowno et al. teach illuminating an entire sensed image, which fully encompasses 
illuminating a part of the subject that corresponds to an image within the electronic zoom area in 
the entire sensed image and a recording control unit (CPU 39) for recording, on a recording 
medium (Memory Card 24), an image that has been captured by the image sensing device (CCD 
20) after the image has been composed; Kowno et al. do not specifically disclose a light- 
emission control unit that is for controlling a strobe light-emission device in such a manner that 
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the strobe light-emission device illuminates precisely a position of a subject that corresponds to 
the center point of the designated electronic zoom area. 

In analogous art, Okamura also disclose an image sensing apparatus and a method of 
operating thereof including designating a zoom feature. More specifically, Okamura teaches, as 
shown in figures 1 and 2 and as stated in columns 3 (lines 1 - 5, 34 - 45, and 62 - 67) and 4 
(lines 1 - 20), an image sensing apparatus including a zoom switch (113) such that when the 
zoom switch (1 13) is operated, a zoom lens (102) is moved accordingly, wherein a flash control 
device (109), also included in the image sensing apparatus, controls an angle of illumination of 
the flash (1 10) to correspond to a zoomed sensed image. Moreover, Okamura "controls the 
illuminating angle of the flash device 110 according to the magnification varying information." 
Therefore, Okamura provides said light control unit changing a light emitting angle of the strobe 
light-emission device based on the zoomed image, as claimed. The Examiner stresses since the 
test for obviousness is what the combined teachings of the references would have suggested to 
those of ordinary skill in the art, it is irrelevant whether or not the zooming performed by 
Okamura is an optical zoom or an electronic zoom . 

Therefore, at the time the invention was made it would have been obvious to one with 
ordinary skill in the art to have changed a light emitting angle of the strobe light-emission device 
based on the electronically magnified image, as suggested by Okamura, in the image sensing 
apparatus and corresponding method, disclosed by Kowno et al., for the advantage of "taking a 
shot of an object with an adequate amount of exposure " (see column 1 , lines 20 - 22, of 
Okamura). 
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14. As for Claim 10 5 Kowno et al. disclose, as stated in paragraphs 50 and 157, wherein the 
electronic zoom device electronically magnifies the image in the designated zoom area by 
changing a downsampling ratio ("thinning"). 



Conclusion 

15. THIS ACTION IS MADE FINAL, Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 . 1 36(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 

16. Any inquiry concerning this communication or earlier communications from the 
Examiner should be directed to Justin P Misleh whose telephone number is 571.272.73 13. The 
Examiner can normally be reached on Monday through Friday from 8:00 AM to 5:00 PM. 

If attempts to reach the Examiner by telephone are unsuccessful, the Examiner's 
supervisor, Lin Ye can be reached on 571.272.7372. The fax phone number for the organization 
where this application or proceeding is assigned is 571.273.8300. 
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Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 



JPM 

June 25, 2007 
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